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Introductlon 

We  have  undertaken  an  in-depth  survey  of  managerial  information 
needs  and  the  DP  practices  and  application  systems  intended  to  fulfill 
those  needs.   The  objective  is  to  improve  our  understanding  of 
managerial  end-users  of  computer  systems  —  what  types  of  systems  do 
they  have  and  how  satisfied  are  they  with  them;  what  types  of  systems 
do  they  want  and  what  is  inhibiting  their  development;  how  do  they 
perceive  their  DP  departments  and  why;  what  are  their  priorities  and 
how  is  DP  performing;  etc.   We  are  also  investigating  these  issues 
from  the  point  of  view  of  DP  management  to  identify  areas  of  agreement 
and  mis- perception . 

The  approach  has  been  to  directly  survey  user  and  DP  managers  on 
needs,  procedures,  policies,  priorities  and  performance.   This  is  not 
unlike  a  traditional  marketing  study,  where  a  company  surveys  its 
customers  and  potential  customers  tc  texermine  their  needs  in  order  to 
affect  product  design,  product  mix,  manufacturing  procedures  and 
corporate  planning.   Without  a  reliable  needs  definition  for 
end-users,  it  is  conceivable  that  DP  departmental  and  systems  plans 
will  simply  bypass  users'  true  needs. 

In  the  first  phase  of  this  study  we  have  identified  the  relevant 
factors;  developed  an  explanatory  model  of  factor  interaction; 
prepared  an  extensive  que scionnair e ;  and  gathered  data  from  IIU  DP  and 
user  managers  in  six  companies.   The  results  from  the  initial  data 
analysis  are  presented  in  this  paper.   Subsequent  papers  will  report 
on  additional  data  already  gathered  but  not  yet  analyzed,  on  more 
detailed  analysis  of  this  data,  a  revised  model  and  measurement 
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techniques,  and  the  results  from  additional  data  to  be  gathered  in  a 
larger  survey  of  users.   Our  goal  is  to  build  upon  a  better 
understanding  of  managerial  end-users  to  develop  practical 
reconmendations  for  DP  and  user  management  which  facilitate  needs 
recognition  and  fulfillment. 
purpose 

The  purpose  of  the  User  Needs  Survey  is  to  recommend  enhancements 
in  DP  and  user  management  practices  for: 

•  implementing  higher  quality  systems 
»   fulfilling  recognized  user  needs 

•  expanding  user  perceptions  of  needed  systems 

•  improving  basic  user  attitudes  toward  DP 

•  improving  DP  responsiveness  to  users'  needs 

We  are  primarily  interested  in  managerially  actionable  factors  and 
explanations  in  this  critical  area  of  research.   Our  purpose  is  not 
merely  to  classify  and  characterize  symptoms;  rather  to  understand 
causes  and  the  impacts  of  alternative  practices  en  outcomes.'   Towards 
this  end,  this  phase  of  the  study  has  six  preliminary  objectives: 

1.  to  classify  and  evaluate  existing  systems 

by  *  type  of  system 

•  quality  and  importance 
**  development  process 

2.  to  classify  recognized  but  unfulfilled  user  information  needs 
by  *  type  of  system 

■  number  of  systems  required 

3.  to  identify  constraints  on  user  perception  of  r.eeded  systems 
by  •  causes  (eg.  awareness,  attitudes,  experiences,  etc.) 

•  type  of  system 
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1.   to  characterize  and  explain  the  basic  responses  of  users  to  DP 
by  •  pro-active  or  resistant  behavior 

•  going  outside  the  firm  for  DP  services 

•  failure  to  recognize  where  DP  systems  are  needed 

•  pressure  to  centralize  or  decentralize 

5.  to  measure  the  quality  and  effectiveness  of  existing  policies 
and  procedures 

by  •  priorities  of  DP  and  user  managers 

•  success  on  relevant  dimensions 

6.  to  develop  and  validate  a  model  which  explains  the 
interactions  of  the  previous  factors  and  allows  management  to 
better  respond  to  specific  DP  and  user  problem  environments. 

Methodology 

In  order  to  study  this  complex  process  of  user  needs  recognition 
and  fulfillment  we  have  developed  a  preliminary  model  of  the  process, 
a  comprehensive  questionnaire,  and  a  special  procedure  for 
administering  this  questionnaire  . 

Figure  1  presents  the  research  model  used  in  this  survey.   Each 
box  and  arrow  is  composed  of  a  cluster  of  factors  (this  is  a  standard 
method  for  reducing  the  number  of  interactions  to  a  compr ehendabl e 
number).   The  basic  model  is  conceptually  straightforward.   A  user's 
past  experiences  with  DP  affects  his  ability  to  perceive  opportunities 
for  systems-based  help  and  his  attitudes  toward  the  DP  department. 
User  needs-recognition  is  the  result  of  experience-based  perception 
'iiid    DP  support  for  informal  pre-proposal  investigation  and  actual 
proposal  preparation.   DP  policies  and  procedures  provide  the  services 


which  determine  a  user's  system  experiences  and  support  for  needs 
recognition  and  fulfillment  of  needs.   This  type  of  circular  analysis 
can  be  pursued  for  any  end-user  to  understand  his/her  current 
situation  and  devise  a  plan  for  change,  if  appropriate.   In  addition, 
the  situations  of  many  users  can  be  aggregated  to  understand 
departmental  or  corporate  responses  to  DP  on  a  macro  basis. 

This  research  model  was  used  to  prioritize  the  thousands  of 
factors  and  interesting  questions  which  could  have  been  asked  in  the 
survey.   The  resulting  questionnaire  has  31^  items  in  total,  although 
not  all  questions  are  answered  by  every  respondent.   There  are  five 
seperate  sections  of  the  questionnaire  so  that  each  manager  receives 
only  questions  directly  relevant  to  his  or  her  organizational 
position.   Each  questionnaire  was  personally  administered  to  each 
respondent  to  ensure  a  near  perfect  response  rate  and  the  integrity  of 
the  stratified  sample.   Consequently,  the  maximum  time  necessary  to 
complete  a  questionnaire  is  one  hour.  Appendix  1  contains  a  sample 
section  of  the  questionnaire. 

Six  companies  were  selected  to  participate  in  the  first  phase  of 
this  survey.   In  each  company  three  departments  were  sel ected--DP , 
finance,  and  Manufacturing.    Within  each  department  a  stratified 
sample  of  senior,  middle,  and  junior  managers  was  asked  to  respond  to 
the  questionnaire.   Respondents  were  selected  by  name  after  interviews 


Note  that  in  most  companies  the  Finance/ Account ing  functions 
were  the  first  to  be  computerized  and  manufacturing  is  now  a 
rapidly  growing  application  area.   This  provides  a  good 
contrast  between  "old"  and  "new"  user  departments. 
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wlth  top  management  to  identify  incumbents  of  specific  roles  within 
each  department.   Respondent  anonymity  and  company  confidentiality 
are,  of  course,  maintained.   Figures  2  and  3  display  some  information 
about  the  six  companies  and  the  sample  respondents. 


Figure  2 

The  Six  Company  Sample 


Number  of 
Company   I nd  ustry     Annual  Sales   DP  Budget  J    DP /Sales   R  e  spondents 


1  Manufacture 

2  Electronics 

3  Manufacture 

4  Chemical 

5  Electronics 

6  Electronics 


110m 
50m 

240m 
65m 

700m 
67m 


2.2m 

2% 

11 

1  .Om 

2% 

34 

2. Mm 

1$ 

16 

0.5m 

0 

.6% 

16 

5.5m 

0, 

.ii% 

12 

0.  36m 

0, 

.53$ 

25 

111* 


Figure  3 
Respondents  Sample 


Department 
Finance 
Manufacturing 
Total  Users 

DP 
Total  Sample 


Questionnaires 

administered 

Questionnaires 
completed 

Response 
rate 

37 

33 

89J 

53 

MS 

9^% 

90 

81 

90% 

34 

33 

97% 

124 

.114 

92% 
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Preliminarv  Results 


There  is  a  great  deal  of  information  in  the  database,  only 
portions  of  which  have  been  analyzed  to  date.   The  preliminary  results 
presented  herein  are  primarily  status  variables,  observations  of 
current  situations  or  facts,  not  the  causal  relationships  behind  them. 
Subsequent  analysis  of  additional  status  variables  and  their 
interrelationships  per  the  research  model  should  demonstrate  causal 
relationships  and,  by  implication,  recommendations  for  change.   We 
caution  the  reader  about  prematurely  assigning  causes  to  these  facts 
before  our  analysis' is  complete. 

The  reliability  of  the  data  gathered  by  the  questionnaire  is 
excellent.   We  have  (1)  interviewed  respondents  before  and  after 
completing  the  questionnaire  to  corroberate  their  responses,  (2) 
provided  the  opportunity  for  all  respondents  to  ask  clarifying 
questions,  and  (3),  checked  the  distributions  of  reponses  to 
individual  questions  to  assure  item  discrimination  and  well-behaved 
distributions.   Further,  the  respondents  have  been  universally 
cooperative,  considering  the  purpose  important  and  taking  the 
questionnaire  seriously.   We  are  especially  pleased  with  the 
sophisticated  discrimination  of  the  user  managers;  where  they  have 
negative  opinions  of  one  aspect  of  DP,  they  have  not  allowed  that  to 
cast  a  shadow  over  other  aspects  where  their  DP  department  is  doing 
comparatively  well.   Moreover,  where  DP  is  performing  comparatively 
well  but  there  is  room  for  improvement,  user  managers  have  not 
overrated  that  aspect. 
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System  Typps 

There  has  been  a  lot  of  discussion  contrasting  transaction 
processing  applications  with  newer  types  of  systems  such  as  on-line 
inquiry  and  decision  support  systems.   Using  the  classification  of 
system  types  in  Figure  1  we  gathered  data  on  installed  and  desired 
systems. 

Figure  4 
Pef j-r.UJ-Qns  Qf   Sygve^:s  Type? 


monitor 
exception 
inquiry 
analysis 


Description  of  DP  Systens  Types 

the  system  ropr,  iters  daily  detail  activity  producing 
^t-^TJard  reports  on  a  fixecj  schedule  (daily,  weekly,  or 
monthl y ) 

the  system  processes  daily  detail  activity  but  produces 
except  ion  reports  where  the  definition  of  es^ceptJigQ 

£.Qn<iixi:Qv.?.  .i-.3  .fr^'.'^'^A 

the  system  provides  a  database  with  flexible  inquiry 
capability  enabling  ra ^ r, ^ r e r ?  to  design  and  change  their 
own  monitoring  and  exception  reports 

the  system  provides  powerful  (j^t  9  90^^  y?  J,?  capabilities 
(modeling,  simulation,  optimization,  or  statistical 
routines)  and  the  appropriate  database  to  support 

:  e  r  i  a  1  decision  making. 


We  are  all  expecting  a  shift  in  user  demand  toward  newer  system  types 
but  is  it  really  there  and,  if  so,  what  is  the  magnitude  of  the  shift? 
Each  user  manager  was  asked  to  list  the  systems  that  he/she  used 
regularly  and  then  to  classify  them.   Each  user  manager  was  also  asked 
to  list  and  classify  systems  requested  but  not  yet  installed  (DP 
backlog)  and  systems  desired  but  not  yet  requested  (invisible 
additional  backlog) . 
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Figure  5  displays  the  results  from  81  user  managers.   On  the 
average  these  managers  regularly  used  3  • 'i  systems  each.   Of  the  277 
installed  systems  listed,  90. 3J  are  transaction  processors  while  only 
6.5%    are  flexible  inquiry  systems  and  merely  3.2$  can  be  classfied  as 
analysis  type  systems.   This  should  be  no  surprise,  but  it  serves  as  a 
baseline  to  interpret  future  trends. 


Figure  5 

Pigtr?.but  ions  gf  System  TVPf^g 


installed   number 

%    of  total 


backlog 


number 

%    of  total 


invisible   number 

%    of  total 


demand 


number 

%    of  total 


ratio  of  percents 
growth  rate 
distribution  change 
(percentage  points) 


ppnitgr  exceptjQp, 


228 
82.3 

82 
43.6 

118 
38 

200 
40 


.5 


88J 

4'42 


22 

8 

30 

16 

71 
23 

101 
20 

2.5 

460$ 
t12 


18 

6.5 

36 
19 

63 
20 

99 
20 

3 

550$ 
^13. 5 


9 

3.2 

40 

21  .4 

57 
18 

97 
20 

6.5 

1077$ 
t  16.  8 


277 

188 

309 
M97 


1.8 
179$ 


The  known  backlog,  under  which  most  DP  shops  are  buried,  is  188 
systems  or  68$  of  the  currently  installed  base.   The  invisible 
backlog,  however,  is  309  systems  or  169$  of  the  known  backlog;  it  is 
actually  larger  than  the  installed  base!   Total  user  demand  (known 
plus  invisible  backlogs)  is  overwhelming  --  497  systems,  180$  of  the 
installed  base.   Certainly  the  invisible  backlog  number  is  less 
reliable  than  the  known  backlog  and,  hopefully,  it  is  overstated. 
Nonetheless,  fulfilling  such  a  demand  may  well  necessitate  major 
changes  in  systems  development  and  project  prioritization  procedures, 
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Not  only  is  user  demand  overwhelmingly  large  but  the  distribution 
of  system  types  is  changing  dramatically.   Demand  for  analysis  systems 
is  up  to  20?,  over  six  times  its  current  proportion.  The  combination 
of  growth  in  overall  demand  and  the  shift  in  proportion  yields  a 
growth  rate  for  analysis  type  systems  of  over  1000$.   Comparatively, 
demand  for  monitoring  systems  is  down  to  MOJ,  only  one  half  its 
current  proportion.   This  does  not,  however,  imply  that  we  can  ignore 
monitoring  systems;  for  the  overall  increase  in  demand  is  so  large 
that  the  40J  proportion  still  numbers  200  systems  or  b8%    of  the  228 
installed  monitoring  systems.   What  it  does  imply  is  a  differentiated 
approach  within  DP  to  be  able  to  successfully  develop  both  monitoring 
and  analysis  systems. 

Similarily,  the  demand  for  exception  reporting  systems  is  up  from 
831  to  20?  and  flexible  inquiry  system  demand  is  up  from  b.5%    to  20$. 
Given  the  overall  growth  rate  of  180$,  this  yields  growth  rates  of 
H(>0%    and  550?  respectively,  placing  even  greater  demands  on  DP  for  a 
mix  of  different  system  types  and  the  differentiated  procedures  for 
their  successful  creation. 

A  very  encouraging  fact,  and  for  us  surprising,  is  that  the 
current  known  backlog  is  representative  of  the  proportions  in  the 
Invisible  backlog  and  total  demand.   This  implies  that  changes  in  DP 
policies  and  procedures  to  adapt  to  the  known  backlog  will  be  viable 
In  the  longer  term.   Concomittantly ,  this  increases  the  pressure  on  DP 
to  adapt  now,  by  obviating  the  argument  for  postponing  change  on  the 
grounds  of  an  unpredictable  future. 
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^UDPort  for  Important  Tasks 

In  a  separate  set  of  questions  we  asked  user  managers  to  list 

their  three  most  important  tasks  or  decisions  which  could  conceivably 

be  supported  by  a  computer  system.   We  then  asked  what  type  of  system 

they  had  to  support  each  task  and  what  type  they  would  like  to  have. 

Figure  6  displays  the  result  of  these  questions  for  81  managers. 

Figure  6 
System  Types  for  Inportant  Tasks 


none 
installed  type     79 
%    of  total        3^% 


monitor   exception  inquiry   analysis   total 
120         9         12         9         230 
52$        H%  5%  h% 


#  installed  of 
appropriate  type    0 

%    of  type  approp    0 


30 

25% 


^k% 


8 

ee% 


7 

78$ 


46 

20$ 


of  120  monitor      0 
%    of  total  0 


30 

25$ 


14 
12$ 


41 

38$ 


33 

28$ 


120 


Of  the  230  important  tasks  79  or  34$  were  not  supported  by  any  type  of 
system,   52$  are  supported  in  some  way  by  monitoring  systems  whereas 
only  4$  are  supported  by  an  analysis  system. 

The  next  two  lines  in  Figure  6  indicate  the  number  of  each  system 
type  deemed  appropriate  for  the  task  by  its  user  manager.   A  system 
for  a  particular  important  task  was  judged  to  be  of  the  appropriate 
type  when  the  user  manager's  desired  type  of  system  was  the  same  as 
}      the  actual  type.   Of  the  9  analysis  systems  7,  or  78$,  were  judged  to 
be  appropriate.  In  contrast,  only  30,  or  25$,  of  the  monitoring 
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systems  were  Judged  appropriate  and  none  of  the  79  important  tasks 
without  support  were  judged  to  be  unsupportabl e  by  computer  systems. 
For  managerially  important  tasks  the  satisfaction  level  varies  by 
system  type,  with  inquiry  and  analysis  rated  significantly  higher. 

The  last  two  lines  in  Figure  6  provide  a  breakout  of  the  120 
installed  monitoring  systems  by  desired  type.   No  managers  felt  that 
computer  support  was  completely  inappropriate;  rather  they  would 
prefer  inquiry  (38$)  or  analysis  (28?)  systems.   Note  that  user 
managers  are  not  just  asking  for  the  sky  nor  are  they  sim ply ' enamo ur ed 
with  technical  fads,  for  30  of  the  monitoring  systems  are  judged  to  be 
quite  appropriate  for  the  task  at  hand. 

Clearly,  this  is  an  undeniable  source  of  user  dissatisfaction. 
Most  installed  systems  are  judged  by  user  managers  to  be  of 
inappropriate  type  for  their  important  supportable  tasks.   This  is  a 
more  general  problem  than,  or  perhaps  a  major  cause  of, 
dissatisfaction  with  a  system's  design,  development  schedule/cost,  or 
report  contents.   It  is  difficult,  if  not  impossible,  for  the  33  of 
120  monitoring  systems  which  "should"  have  been  analysis  systems  to  be 
considered  successful  by  users  no  matter  how  dedicated  or  competent 
the  DP  personnel. 

Figure  7  compares  the  distribution  of  system  types  for  all 
installed  systems  (277)  and  those  listed  as  relevant  to  important 
tasks  (150).   Of  the  277  systems  cited  by  respondents,  127  were  not 
even  mentioned  whon  respondents  were  subsequently  asked  to  list 
systems  which  related  to  their  most  important  tasks  or  decisions. 
Nine  installed  systems  are  classified  as  analysis  type,  all  nine  or 
100J  were  cited  in  conjunction  with  important  tasks.   In  contrast,  of 
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tte  228  monitoring  systems  installed  only  120  or  53$  even  related  to 


Figure  7 

'IJmpgrt  ant"  JY?tem?  Sufg^t 


ej^cept 

j-on 

i  R  g  u  i  r  y 
18 

an^i Y9 

l2 

t<?tal 

22 

9 

277 

9 

12 

9 

150 

4U 

61% 

1005^ 

55? 

PcnJrtQrinp; 
all  systems  228 

"important"  systems    120 
%    of  all  systems        53$ 

managers  most  important  tasks  and,  of  those,  only  30  (25$)  are  of 
appropriate  type. 

Figures  6  and  J    consider  DP  '  s  product  mix  with  respect  to  user 
needs  and  conclude  that  this  is  an  undeniable  source  of  user 
dissatisfaction.   For  user  manager's  important  tasks:  (1)  3^$  have  no 
systems  support  of  any  kind  (2),  -46$  of  the  installed  systems  do  not 
relate  to  important  tasks,  and  (3),  of  those  systems  which  do  relate 
to  important  tasks,  only  31$  are  of  the  appropriate  type.   Although 
otber  factors  contribute  to  user  dissatisfaction,  product  mix  alone  is 
sufficient  to  justify  user  manager's  feelings  of  DP • s  managerial 
irrelevance  and  lack  of  responsiveness  to  their  needs. 
Prjorj-ties  &  Performance 

User  and  DP  managers  were  asked  to  prioritize  a  list  of  26 
criteria  for  DP.   Separately,  they  were  asked  to  evaluate  the 
performance  of  DP  on  tnese  same  criteria.   Success  on  each  criterica 
can  be  calculated  by  weighting  performance  with  priority.   (Appendix 
1,  Question  15  contains  the  list  of  criteria.)  The  overall  success  ii^ 
disappointingly,  but  realistically,  low.   On  a  scale  from  1  to  7  where 
5  is  good  and  3  is  inadequate,  the  users  rated  DP  a  U.306  and  DP  rated 
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itself  only  marginally  higher  at  U.MSg.   Clearly  both  DP  and  users 
recognize  that  there  is  ample  room  for  improvement. 

Where,  however,  is  DP  doing  comparatively  well?   The  four  most 
successful  criteria,  as  rated  by  DP  and  users,  are  shown  in  Figure  8, 
each  is  at  least  one  standard  deviation  above  the  overall  average 
rating  on  all  26  criteria.   There  is  amazingly  excellent  agreement 
between  DP  and  Users  on  what  DP  does  best  --  the  top  three  criteria 
are  the  same!   Both  Users  and  DP  are  "accurately"  perceiving  the 
situation  --  DP  is  most  successful  in  operational,  technical  areas. 
You  will  note,  however,  that  even  the  highest  ratings  hover  around  5 
(good)  and  do  not  approach  6  or  7  (excellent)  on  the  scale. 


Figure  8 
Most  Successful  Criteria 


F.  quality  of  DP  systems  analysts  5.333 

H.  technical  competence  of  DP  staff  5. 242 

W.  availability  and  timeliness  of  reports  5.273 

C.  hardware  and  systems  downtime  5.091 


.  overall  average  rating  on  26  criteria 

User  r9t;r.p:  pf  P? 


4.489 


C  -     .501 


H.   technical  competence  of  DP  staff  5.257 

F.   quality  of    DP  systems  analysts  4.986 

W.   availability  and  timeliness  of  reports    4.962 


overall  average  rating  on  26  criteria 


4.306 


=  .439 


Letters  used  in  Figure  relate  to  items  in  Appendix  2. 


Where  is  DP  least  successful?   Figure  9  lists  the  worst  four  criteria 
on  DP  and  user  ratings.   Users  and  DP  agree  that  training  programs  for 
users  in  general  DP  capabilities  (not  system  specific  implementation 
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tralning)  and  developing  more  analysis  type  systems  are  inadequate  (3 
on  the  scale).   DP  adds  criteria  N  and  Z  to  the  list  (which  users  rate 
below  the  overall  average)  and  Users  add  I  and  L  (which  DP  rates  below 

Figure  9 
Least  Successful  Criteria 

DP  self-ratinp:  rating 

D.  training  programs  for  users  in  DP  capabilities  3-394 

N.  invol  of  senior  user  managers  in  DP  policy  &  eval  3«710 

M,  developing  more  analysis  type  systems  3.750 

Z.  DP  profitability  from  billbacks  and  billable  time  3.750 

overall  average  rating  on  26  criteria  4.489 

User  rating  of  DP  rating 

D.  training  programs  for  users  in  DP  capabilities  3«434 

I.  the  new  systems  request  backlog  3-672 

M.  developing  more  analysis  type  systems  3  "721 

L.  developing  more  inquiry  type  systems  3'785 

overall  average  rating  on  26  criteria  4.306 

average).   Here  again  there  is  reasonable  agreement  between  DP  and 
Users'  perceptions  of  the  situation.   Apparently  where  DP  does  poorly, 
especially  from  the  users  perspective,  is  in  developing  inquiry  and 
analysis  type  systems,  getting  through  the  backlog  to  be  able  to 
develop  those  systems,  and  general  DP  training  to  help  users 
understand  the  capabilities  of  these  systems.   That  the  key  is  inquiry 
and  analysis  type  systeus  can  be  seen  by  noting  (1)  the  shift  in 
demand  to  these  types  as  previously  discussed  and  (2)  that  in 
contrast,  users  give  an  average  rating  to  monitoring  systems 
development  and  slightly  below  average  to  exception  systems 
development . 

Simply  stated,  the  user  demand  has  shifted  and  DP  has  not 
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responded  adequately.   This  impression  is  strongly  reinforced  by 
noting  that  DP's  priorities  on  criteria  D  (5-139),  I  (4.603),  L, 
(5*038),  and  M  (4.795)  are  all  below  DP's  average  priority  rating 
(5*151)  for  all  26  criteria  (See  Appendix  2  for  a  complete  list  of 
priority  ratings  by  DP  and  users.)   DP  has  not  shifted  its  internal 
priorities  to  respond  to  the  shift  in  user  demand. 

Indeed,  part  of  the  explanation  for  low  overall  ratings  may  be 
simply  that  DP  is  performing  well  on  comparatively  unimportant 
criteria  or  that  users  priorities  are  unrealistic.   User  and  DP  top 
priority  criteria  (one  standard  deviation  above  the  mean)  are  listed 
in  Figure  10  along  with  values  for  priorities  and  performance. 


Figure  10 
User  and  DP  Top  Priorities 

Users'  i;qp  pr;-ori vj-f^?                 prior; vY  perfortn^noe 

0*  responsiveness  to  user  needs             6.091  3.805 

F.  quality  of  DP  systems  analysts           6.030  4.643 

A.  communication  with  managerial  users      5.879  3-962 

G*  attitudes  of  users  to  DP                5-879  3-797 

H.  technical  competence  of  the  DP  staff     5.727  5.000 

users'  overall  average  on  26  criteria       5.075  4.036 

PP'?  tQP  prior^tjeg 

0.  responsiveness  to  user  needs             6.200  4.333 

H.  technical  competence  of  the  DP  staff     5.949  5.121 

W.  availability  and  timeliness  of  reports   5.925  5.273 

DP's  overall  average  on  26  criteria         5-151  4.396 

Users  consider  the  technical  competence  of  the  DP  staff,  the  quality  of 

systems  analysts,  and  their  own  attitudes  toward  DP  to  be  important 

priorities  for  DP  --  not  unrealistic  priorities-  To  this  they  add  the 
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obvious  priorities  of  user  responsiveness  and  communication.   DP  agrees. 
User  responsiveness  is  the  top  priority  criteria  for  both  users  and  DP 
yet  both  see  performance  as  below  average.   Both  rate  technical 
competence  as  a  top  priority  a  .   agree  that  performance  is  significantly 
better  than  average.   Again  the  message  comes  through  that  DP  is  doing 
relatively  well  technically  but  not  in  terms  of  user  responsiveness, 
even  given  that  DP  rates  this  top  priority  and  considers  its  own 
performance  (M.333)  to  be  about  average  (4.396).   Recommendations  for 
management  which  facilitated  this  situation  would  be  welcomed  by  all. 

We  have  explored  areas  of  agreement  between  DP  and  users  on 
priorities  and  performance.   Where,  however,  are  the  areas  of  greatest 
disagreement?   Figure  11  lists  the  priorities  and  performance 
differences  greater  than  one  standard  deviation  from  the  mean. 


Figure  11 
Greatest  Disagreement  between  Users  and  DP 


Priori t  ies 


V.  appropriate  DP  budget  size  or  growth  rate 

Q.  increasing  proportion  of  DP  effort  in  new  systems 

S.  improving  new  systems  development 

N.  involvement  of  senior  user  managers  in  DP  policy 

G.  attitudes  of  users  to  DP 

M.  developing  more  analysis  type  systems 

average  priority  gap  between  Users  &  DP  on  26  criteria 

Per f ormanc  e 

I.  new  systems  request  backlog 

H.  availability  &  timeliness  of  report  delivery  to  users 

C.  hardware  and  systems  aowntime 

L.  developing  more  inquiry  type  systems 

T.  user  oriented  analysts  who  know  user  operations 
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DP  has  significantly  under-rated  the  priority,  with  respect  to 
users,  of  criteria  G,V,M,S,  and  Q,  all  of  which  are  non- technical 
criteria.   In  contrast  users  have  under-rated  the  priority  of 
involvement  of  senior  user  managers  in  DP  policy  formulation  and 
evaluation.   User  managers  rated  this  criterion  of  below  average 
importance.   Clearly,  if  user  managers  want  changes  in  DP  priorities 
and  shifts  in  the  types  of  systems  delivered  they  must  shoulder  the 
responsibility  of  involvement  in  DP  policies.   DP  has  recognized  this 
need  but  is  apparently  being  constrained  by  user  reluctance  and 
failure  to  recognize  its  importance. 

The  greatest  disagreements  on  performance  criteria  are  all  due  to 
DP  over-rating  itself.   DP  thinks  it  is  doing  a  significantly  better 
job  of  managing  the  backlog  problem  than  do  users.   Similarly,  on  two 
technical/operational  criteria,  W  and  C,  and  on  two  additional 
managerial  criteria,  L  and  T,  DP ' s  rating  is  more  optimistic  than 
user' s . 
Company  differences  in  DP  Performance 

These  same  26  criteria  can  be  analyzed  by  company  to  provide  some 
initial  summary  insights  into  user  satisfaction  with  central  data 
processing  and  a  gross  cut  at  the  reasons  behind  relative  satisfaction 
or  dissatisfaction. 

One  way  in  which  to  look  at  the  data  is  to  look  for  performance 
differences  among  companies.   Figure  12  shows  data  for  four  of  the 
companies.   These  four  companies  were  selected  because  of  the  striking 
manner  in  which  they  illustrate  the  results. 

The  Figure  lists  four  separate  sets  of  data.   The  first  of  these, 
Section  1,  provides  summary  measures  of  user  satisfaction.   The  two 
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measures  shown  are  the  users  performance  rating  of  the  "overall  cost 
effectiveness  of  DP"  (item  P  in  Appendix  2)  and  "in  our  company  all  DP 
should  be  centralized"  (Appendix  1,  Question  16,  item  F) .   Relatively 
high  values  on  these  questions  provide  votes  of  confidence  in  central 
DP.   Low  values  are  indications  of  less  satisfaction. 

It  is  clear  from  this  initial  set  of  data  that  companies  D  and  A 
are  given  good  marks  by  their  users.  (Note,  company  designations  are 
purposely  scrambled.)  Company  C  is  significantly  behind  these  two, 
while  the  DP  function  in  company  B  lags  far  behind  in  the  users 
estimation . 

Section  II,  separates  out  user  performance  ratings  by  traditional 
transaction  processing  systems  (monitoring  and  exception).   For 
transaction  processors,  the  same  order  as  above  is  apparent,  except 
that  company  B  is  ranked  about  the  same  as  company  C. 

The  results  in  Section  III,  however,  are  striking  and  go  far  to 
explain  the  summary  satisfaction  results  in  Section  I.   Here  it  is 
apparent  that  the  DP  department  in  company  B  is  very  poorly  rated  in 
its  performance  in  developing  user-oriented  inquiry  and  analysis  type 
systems.   Companies  A  and  D  fare  relatively  much  better  (although  on 
an  absolute  scale  their  average  performance  is  low).   DP  in  company  C, 
however,  scores  extremely  well  in  the  development  of  managerial 
systems,  approaching  "good"  on  analysis  type  systems. 

Sections  IV  and  V  add  to  the  image  developed  in  Sections  II  and 
III  of  the  relati/e  performance  of  the  DP  departments  of  the  four 
companies.   Companies  A  and  D  are  viewed  as  relatively  strong  in  both 
the  efficient  use  of  DP  resources  and  communicating  with  and  assisting 
users  to  satisfy  their  needs.   Company  B  does  reasonably  well  with 
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regard  to  running  existing  systems,  but  fails  badly  in  the  area  of 
user  communication  and  assistance.   The  exact  reverse  is  true  in 
company  C.   It  gets  the  highest  marks  on  user  assistance  and  the 
lowest  on  running  existing  systems. 

Section  IV  deals  with  DP's  ability  to  operate  its  internal 
operations  efficiently  and  to  meet  report  output  schedules  on  a  timely 
basis.   This  section  presents  three  measures  of  DP  performance 
in  efficiently  carrying  out  what  are  essentially  transaction 
processing  functions.   Company  D  dominated,  followed  by  A,  B,  and  C. 
Interestingly,  company  B  is  rated  well  ahead  of  C  on  these  functions 
and  almost  as  high  as  A. 

Section  V  deals  with  the  ability  of  the  DP  organization  to 
interact  effectively  with  users.  This  includes  five  measures  of  DP 
personnel's  ability  to  communicate  with  and  aid  user  personnel.   Here 
company  C  gets  high  marks.   Companies  A  and  D  are  rated  reasonably 
well  and  company  B  lags  well  behind. 

In  summary  the  data  reveal  distinct  differences  from  company  to 
company.   Levels  of  user  acceptance  vary  and  the  reasons  for 
acceptance,  or  lack  of  it  vary  -  and  are  interesting. 

There  is  little  to  choose  between  companies  A  and  D.   Both  DP 
departments  are  relatively  well  accepted  by  users  -  but  for  slightly 
different  reasons.   Company  D  scores  extremely  well  on  traditional 
functions  -  both  in  developing  monitor  and  exception  systems  and  in 
running  existing  systems.   It  is  in  an  approximate  tie  with  company  A 
for  second  place  in  the  development  of  inquiry  and  analysis  type 
systems  and  in  assisting  users  and  interacting  with  them.   Company  A' a 
DP  group  lags  a  bit  behind  company  D  with  regard  to  traditional 
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Figure  12 

DP  Performance  by  Company 
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functlons,  but  otherwise  appears  the  same.   Both  companies,  therefore, 
can  be  viewed  as  doing  an  "acceptable"  job  across  all  functions  at 
this  depth  of  investigation  (N.B.  we  will  probe  deeper  in  the  next 
report  looking  at  many  subsidiary  questions.) 

Company  B  is  the  lowest  rated.   Although  it  is  almost  even  with  A 
in  running  existing  systems.   It  is  rated  lowest  in  developing  all 
types  of  systems.   Most  especially,  it  is  a  disaster  with  regard  to 
the  development  of  inquiry  and  analysis  type  systems  and  in  ongoing 
user  assistance  and  support.   This  complete  lack  of  user  communication 
and  aid  in  developing  the  types  of  systems  that  users  feel  they  need 
earns  it  by  far  the  lowest  user  acceptance. 

Company  C  is  interesting.   On  the  cost  effectiveness  measure 
(Section  I)  it  is  not  far  behind  company  D.   Yet,  on  the  other  measure 
in  this  area,  users  are  strongly  ant i  centralization!   The  data  show 
that  the  DP  department  is  perceived  to  do  a  rather  poor  job  of 
performing  existing  functions  (Section  IV,  Running  existing  systems), 
but  a  crackerjack  job  of  interacting  with  users  (Section  V)  and 
developing  inquiry  and  analysis  systems.   Here  the  users  have 
discriminated  well.   And  they  have  reacted  favorably  to  strong  efforts 
to  improve  their  use  of  computers.   (In  fact,  this  company  has 
recently  decentralized  systems  analysts  to  the  user  departments  -  and 
the  result  is  clear!) 

In  summary,  from  the  company  data,  it  appears  that  users 
discriminate.   They  consider  (1)  progress  in  developing  traditional 
systems,  (2)  progress  in  developing  inquiry  and  analysis  type  systems, 
(3)  the  ability  to  run  a  good  traditional  shop,  and  (U)  the  ability  to 
interact  well  with  them  to  assist  them  in  fulfilling  their  information 
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needs.   If  performance  is  relatively  high  along  all  lines,  users  are 
relatively  pleased.   The  opposite  is  also  true.   Where  performance  is 
high  in  some  areas,  but  perceived  as  low  in  others  the  DP  department's 
score  (cost-effectiveness)  is  in  the  middle. 
User  CapabiJitv  in  DP 

In  another  set  of  questions  users  and  DP  rated  the  user 
departments.  Finance  and  Manufacturing,  on  their  dependence  on  DP  and 
capabilities  of  using  DP.   Figure  13  displays  the  results. 

Users  and  DP  agree  that  Finance  is  generally  more  capable  and 
dependent  on  DP  than  Manufacturing.   This  makes  sense  given  Finance's 
longer  experience  with  DP  and  the  almost  total  computerization  of  most 
accounting  systems.   Conversely,  Manufacturing's  shorter  historical 
exposure  to  DP  is  also  reflected  in  DP ' s  limited  ability  to 
discriminate  within  Manufacturing  as  well  as  they  do  in  Finance.   The 
distribution  of  DP's  ratings  for  Manufacturing  in  Figure  13  is 
significantly  tighter  than  DP's  ratings  of  Finance.   Note,  like  the 
ratings  for  DP  performance  previously  discussed,  the  averages  are  not 
impressive  --  they  hover  between  4  (low)  and  5  (high)  and  do  not 
approach  7  (very  high). 

Areas  of  general  agreement  yield  a  profile  of  users.   They  are 
very  willing  to  use  DP's  services  (D)  but  rate  significantly  lower  in 
terms  of  manap:erial  use  of  systems  (G).   This  contrast  in  use  versus 
managerial  use  is  reflected  in  significant  differences  of  opinion  on 
user  reliance  on  DP  (A).   DP  rates  user  reliance,  especially 
Manufacturing,  much  higher  than  do  users.   Given  the  existing 
distribution  of  system  types  (90?  transaction  processors)  this  is 
understandable.   DP  sees  mostly  the  transaction  processing  aspects  of 


Figure  13 
Ratings  of  Users  by  Users  and  DP 
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users  where  their  reliance  is  heaviest.   User  managers  (the 

c 

respondents  to  this  survey  are  all  non-clerical)  see  mostly  managerial 
activities  which  are  unsupported  (3^!^^)  or  inappropriately  supported 
(76$)  by  transaction  processing  systems. 

Just  as  users  rate  their  reliance  (A)  significantly  lower  than 
does  DP,  so  too  do  they  significantly  underestimate  the  workload  they 
place  on  DP  ( B) .   This  is  reinforced  by  users,  especially 
Manufacturing,  underestimating  the  load  placed  on  DP  by  new  systems 
requests  ( F) .   Although  everyone  agrees  user  patience  with  DP  problems 
(J)  is  about  average,  it  can  never  be  improved  until  users  have  a  more 
accurate  perception  of  their  workload  transfered  to  DP.   Many 
transaction  processing  systems  have  been  installed  so  long  ago,  and 
deal  only  with  details  below  the  managerial  level,  that  user  managers 
have  lost  sight  of  the  workload  they  have  transfered  ( B)  and, 
consequently,  their  reliance  (A)  on  DP  for  daily  operations. 

Users  and  DP  agree  that  user  cooperation  in  developing  new 
systems  (C)  is  good,  approaching  high  (5  on  the  scale),  although  the 
technical  sophistication  of  new  system  requests  (L)  is  not  high.   This 
is  perhaps  fortunate,  for  although  users'  capability  to  use  DP  systems 
(E)  is  high,  their  DP  skills  in  system  creation  are  low:   technical 
competence  (H),  ability  to  clearly  define  needs  (I),  and  project 
management  (K).   Of  course,  this  may  be  a  cause  and  effect  loop;  the 
technical  sophistication  of  system  requests  may  be  constrained  by  low 
user  system  creation  skills. 

Users  rate  themselves  higher  on  project  management  (K)  and  needs 
definttior;  (I)  than  does  DP  --  users'  self  ratings  are  about  average 
whereas  DP  rates  them  about  one  standard  deviation  below  the  mean. 
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Some  bias  in  this  direction  is  expectable*,  but  when  Finance's  self 
rating  is  significantly  higher  than  DP's  on  ability  to  clearly  define 
needs  (I)  there  is  real  cause  for  concern. 

Although  DP's  lower  rating  of  users  on  technical  competence  (H) 
is  due  to  a  similar  bias,  there  is  greater  agreement  and  less  cause 
for  concern.   Users  are  not  responsible  for  technical  expertise  (H)  in 
computers  like  they  are,  or  should  be,  for  clear  needs  definition  (I) . 

In  summary,  users  are  willing  (D),  cooperative  ( C)  and  capable 
(E)  to  use  systems  but  their  skills  in  creating  systems  --  technical 
(H),  needs  definition  (I)  and  project  management  (K)  --  are  lacking. 
This  is  either  a  cause  of,  or  a  result  of,  limited  managerial  use  (G) 
of  technically  non- so  phi sticated  (L)  systems. 

To  a  certain  extent  users  have  recognized  this  problem  and  desire 

significantly  more  help  from  DP  in  two  areas-- training  programs  and 

proposal  development.   Users  rated  the  availability,  quality  and 

subject  breadth  of  general  DP  education  courses  for  users  and  how 

active  and  supportive  their  DP  department  is  in  providing  access  to 

these  courses.   Figure  14  shows  the  actual  training  program  and  that 

desired  by  users.   Clearly  there  is  a  need  for  user  education  in 

general  DP  capabilities  and  a  desire  for  significantly  more  support  in 

this  area.   DP  management  could  improve  its  own  life  by  helping  users 

to  learn  more  about  DP-- improving  patience  (J),  defining  needs  (I), 

project  management  (K)  and  technical  competence  (H). 

Figure  14 
General  DP  Training  Programs:   Actual  and  User  Desired 
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froDOsal  Development 


Users  have  unfulfilled  demands  for  inquiry  and  analysis  type 
systems.   Users  also  have  relatively  little  experience  with  these 
system  types,  low  technical  and  project  management  skills,  and 
difficulty  clearly  defining  their  system  needs.   DP  support  for 
proposal  development  can  be  considered  as  a  way  out  this  trap  if  users 
desire  such  help . 

Proposal  development  entails  several  tasks,  each  of  which  was 
rated  by  users  for  current  and  desired  support.   Figure  15  displays 
the  results.   Current  support  for  proposal  development  on  all 
dimensions  is  disappointingly  low,  the  desired  level  is  universally 
and  significantly  higher.   Assessing  technical  feasibility  (D)  is  most 
important  and  best  supported  currently.   Recognizing  potential 
applications  (A)  is  important  but  has  the  largest  gap  between  actual 
and  desired  support.   Similarily,  developing  "hard"  ( B)  and  "soft"  (C) 
cost/benefits  are  key  areas  of  desired  improvement. 

Users  need  proposal  development  support  and  recognize  these 
needs.   DP  can  benefit  from  providing  this  support  and  could  link  this 
to  user  training  programs  as  a  two  pronged  approach  for  increasing 
user  capabilities  in  DP. 
Macro  Responses  of  Users  to  the  Situation 

What  do  users  conclude  from  this  depressing  assessment  of  DP 
performances,  mis-placed  priorities,  and  unfulfilled  demand  for 
systems,  training,  and  proposal  support? 

They  could  simply  ignore  data  processing  as  a  viable  problem 
solving  technique.   Users  were  asked  three  questions  to  see  if  this 


Figure  15 
DP  Support  for  Proposal  Development 
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A.  recognizing  potential  areas  for  DP  systems 

B.  developing  the  cost/benefit  estimates  of  a  new  DP  system 

C.  developing  qualitative  benefits  of  a  new  DP  system 

D.  assessing  the  technical  feasibility  of  a  new  DP  system 

E.  assessing  the  organizational  impacts  of  a  new  DP  system 

F.  working  the  politics  of  proposal  or  budget  approval 
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was  the  case.   See  Figure  16  where  the  median  response  to  each  item  by 
81  managers  is  posted.   The  responses  to  items  A,G  and  J  are 
consistant  and  strong;  users  are  not  ignoring  DP--they  still  believe 
that  DP  systems  are  worthwhile,  relevant,  and  important. 

If  thats  the  case,  then  perhaps  users  desire  to  fulfill  their 
needs  by  going  to  outside  DP  services.   Item  C  implies  that  this  might 
be  the  case  but  items  I  and  L  eliminate  that  explanation. 

Well  then,  perhaps  users  want  to  decentralize  DP,  thinking  they 
can  do  a  better  job,  especially  in  user- or ien ted  systems  development. 
Clearly  users  do  not  want  to  decentralize  hardware  (D),  nor  are  they 
pushing  strongly  for  decentralization  of  systems  development  (E). 
However,  users  do  not  want  DP  completely  centralized  either  ( F)  . 
Perhaps  they  want  some  decentralization  or  influence  over  DP 
management  issues  like  services  provided  (training,  proposal  support) 
or  mix  of  system  types  (inquiry  and  analysis)  or  simply  selective 
decentralization.   Although  probably  they  are  Just  as  confused  over 
the  right  way  to  go  on  the  central iza tion/ dec  en tral i za tion  issue  as 
most  DP  managers. 

Having  eliminated  several  possible  macro  responses,  what  then  is 
the  user's  response?   Items  H,  B  and  K  imply  that  users  will  continue 
to  do  the  best  they  can  with  what  they  have.   They  will  seek  out  DP's 
help  in  problem  solving,  rely  on  DP  for  systems  development,  and 
cooperate  with  systems  implementation.   Users  are  dissatisfied  but  are 
not  writing-off  their  DP  departments.   Computer  systems  are 
worthwhile,  relevant  and  important  and  users  are  willing  to  work  with 
DP  to  improve  the  current  situation. 
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Figure  16 

User  Responses  to  Macro  Issues 


For  each  of  the  following  statements  please  indicate  the 
extent  of  your  agreement  or  disagreement.   Use  this  scale  and 
post  the  appropriate  number  next  to  each  statement. 
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A.  In    gernal    DP    systems    are    a    waste    of   money,    time    and 
effort. 

B.  I'd    rather    forego    a    necessary    DP    system    than    get    out    DP 
department    involved. 

C.  Our    DP   department    may    not    be    perfect    but    they    are    better 
than    any    outside    service    bureau. 

D.  We    would    be    better    off    if    running    existing;    systems    and 
hardware    was    decentralized    and    under    direct    user    control. 

E.  We    would    be    bettere    off    if    new    systems    development    was 
decentralized    and    under    direct    user    control. 

F.  In    our    company    all    DP    should    be    centralized. 

G.  The    things    a    DP    system    can    do    are    not    important    compared 
to    the    real    needs    of   my    job. 

H.     I    seek    out    opportunities    to    get    DP    involved    in    helping    to 
solve    our    problems. 

I.     All    DP    systems    for    our    department    should    be    developed    and 
implemented    by    outside    consultants,    service    bureaus    or 
software    houses. 

J.    DP    systems    are    an    important    tool    for    improving    the 
performance    of    our    department. 

K.     I'll    cooperate    if    required    with    a    DP    system    scheduled    to 
be    implemented    in    my    department    but    I    have    more    important 
things    to    do  . 

.L  .     If    we    had    a    really    important    DP    system    to    develop    we'd 
better    off    to    go    outside. 
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Summarv 

The  preliminary  results  from  the  User  Needs  Survey  are 
encouraging  in  the  sense  that  they  are  reliable  and  clearly  reveal 
many  interesting  facts.   The  results  are  challenging  in  the  sense  that 
major  DP  and  user  improvements  are  necessary  and  further  analysis  of 
our  data  should  yield  some  insights  into  problem  causes  and 
recommendations. 

User  satisfaction  with  DP  performance  is  low  and  many  areas  of 
improvement  are  identified.   Nonetheless,  user  demand  for  more  systems 
and  the  shift  in  system  mix  is  overwhelming. 

Greater  involvement  of  users  in  DP  policy  formulation  is  called 
for  by  DP  along  with  improved  skills_  in  systems  creation  --  project 
management,  needs  specification  and  DP  technologies.   Certainly  users 
must  shoulder  more  of  the  responsibility  for  fulfilling  their  own 
needs. 

Many  problems  between  various  functional  departments  in  a  firm  go 
unresolved  because  of  lack  of  agreement  on  priorities  and  problem 
definitions.   However,  this  survey  has  revealed  surprising  agreement 
between  users  and  DP  on  problem  areas.   Although  there  are  certainly 
areas  of  disagreement  between  users  and  DP,  with  the  agreement  that 
does  exist,  you  would  expect  serious  efforts  to  resolve  those 
problems.   This  does  not  appear  to  be  the  case.   Apparently  the  reason 
for  this  lack  of  pi^oblem  resolution  is  that  neither  users  nor  DP 
really  understand  what  to  do.   What  actions  should  be  taken  --  which 
policies  and  procedures  should  be  changed  and  how?   The  number  of 
interacting  factors  and  cur  lack  of  understanding  in  how  they  interact 
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is  preventing  changes  for  problem  resolution.   The  goal  of  this 
research  effort  is  to  develop  a  viable  model  of  factor  interaction,  to 
break  the  log-jam  of  inactivity  due  to  lack  of  understanding,  and  to 
make  recommendations  for  managerial  action  in  policies  and  procedures. 

There  is  hope.   This  survey  itself  has  demonstrated 
sophisticated  user  understanding  and  discrimination  among  diverse  DP 
issues  and  serious  attention  to  user  needs  by  DP.   Subsequent  reports 
on  the  User  Needs  Survey  will  make  managerial  recommendations  for 
responses  to  the  problems  and  potentials  identified. 

In  spite  of  the  impediments,  users  consider  computer  systems 
worthwhile,  relevant  and  important.   Users  are  not  only  willing  to  use 
systems  and  cooperate  in  their  development  but  recognize  a  need  for 
more  DP  training  and  proposal  development  support. 


APPENDIX  1 


USER  NEEDS  SURVEY  QUESTIONNAIRE 
Section  E 


CENTER  FOR  INFORMATION  SYSTEMS  RESEARCH 


Alfred  P.  Sloan  School  of  Management 
Massachusetts  Institute  of  Technology 


E53-316,  50  Memorial  Drive,  Cambridge,  MA  02139 


Number 


1.  All  of  the  job  characteristics  listed  below  have  probably  occurred  at 
some  point  in  time  on  your  job.  However,  we  are  interested  in  the 
general  nature  of  your  job.  Please  post  the  number  from  this  scale 
which  best  indicates  how  typical  each  characteristic  is  of  your  job. 

not  at  all  somewhat  completely 

typical  typical  typical  dominant 


A.  many  decisions,  each  of  which  involve  a  few,  known,  quantifiable 

factors  where  a  best  decision  can  be  calculated 

B.  high  uncertainty  in  defining  a  good  decision  or  success  in  my 

job 

C.     well-defined  responsibility  boundaries  which  everyone  knows 

D.     interdepartmental   coordination  where  conflicting  goals  produce 

trade-offs 

E.  changes  outside  the  firm  require  changes  to  decisions  or  proce- 
dures 

F.  assessment  of  the  competition  and  long  range  planning  is  manda- 
tory 

G.  each  factor  is  known  but  there  are  so  many  that  they  are  com- 
pletely overwhelming 

H.  a  few  key  decisions  where  "best"  is  not  clear  to  anyone 

2.  What  percent  of  the  information  you  currently  get  from  DP  is  not  useful 
to  you?    % 


3.  When  new  DP  systems  are  created  there  is  frequently  a  project  overrun. 
What  do  you  think  the  average  percent  project  budget  and  schedule  over- 
runs are  in  your  organization? 

average  budget  overrun  %  average  schedule  overrun  % 


Do  you  think  that  the  current  DP  policy  and  procedures  for  the  alloca- 
tion of  DP  costs  to  users  are  equitable  to  your  department?  Post  your 
response  using  this  scale  to  the  four  categories  of  DP  services  listed. 
(If  you  don't  know  what  the  policy  and  procedures  are,  check  here  .) 


outrageously 
unfair 


unfair 


reasonable 


very 
equitable 


1 


A  proposal  preparation 

B  new  system  development 

C  running  existing  systems 

D  maintenance  or  enhancement  of  existing  systems 

Every  manager  has  dozens  of  tasks  and  decisions  for  which  he/she  is  respon- 
sible. However,  there  are  usually  just  a  few  which  are  critical.  Could 
you  please  briefly  describe  the  top  three  which  are  or  could  be  supported 
by  some  type  of  DP  system. 

1. 


2. 

3. 


A.  Please  indicate  for  each  of  the  top  three  you  listed  what  type  of  DP 
system  support  you  currently  have  by  posting  a  number  1  to  4  (refer 
to  the  Definitions  Page  for  DP  system  type)  in  the  column  below  head- 
ed "current. " 


B.  Please  indicate  for  each  of  the  top  three  what  type  of  DP  system  sup 
port  you  would  like  to  have  by  posting  a  number  I  to  4  (refer  to  the 
Definitions  Page  again)  in  the  column  below  headed  "desired." 


Please  think  for  just  a  moment  about  the  value  of  the  desired  type  of 
DP  system  support  you  indicated  below.  To  the  nearest  thousand  dol- 
lars, what  would  the  nonthly  value  of  such  a  system  be?  Post  in  the 
column  below  headed  "value."  (Best  guesses  acceptable.) 


critical 
tasks  or 
decisions 

1. 

A. 

current  type 

2. 

t 

3. 

B. 

desired  type 


$_ 
$_ 

$ 


C. 

value 


_/month 

_/month 

/month 


Consider  all  the  DP  systems  you  don't  have  but  would  like  to  have  (in- 
clude systems  in  progress,  requested  not  approved,  and  not  yet  requested). 

A.  Please  indicate  how  many  there  are  by  type.  Post  the  approximate 
number  in  the  row  labeled  "how  many"  below  each  DP  system  type  listed. 

B.  How  important  are  these  types  of  systems  you  don't  have  but  would 
like  to  have?  Post  a  number  from  this  scale  to  the  row  below  labeled 
"importance." 


nice  to  have 


important 


necessary 


critical 


C.  Have  you  submitted  formal  proposals  to  DP  for  new  systems  which  are 
still  pending?  Please  post  the  number  of  such  proposals  to  the  row 
below  labeled  "number  of  proposals." 


DP  System  Type 
(refer  to  the  Definitions  Page) 


A.  how  many 

B.  importance 

C.  number  of  proposals 


7.   There  is  always  a  mixture  of  quantitative  and  qualitative  benefits  to  a 
new  DP  system.  Consider  a  proDosal  where  quantitative  costs  and  benefits 
breakeven  but  the  qualitative  benefits  look  very   good.  Please  circle  the 
number  on  the  scale  that  most  accurately  describes  what  would  happen  to 
such  a  proposal  in  your  organization. 


1 

2  H 
3 

4  -\ 
5 

6  H 
7 


We  would  never  submit  such  a  proposal  because  everyone  knows  it 
would  be  rejected. 


It  would  be  rejected  on  formal  criteria  but  we  could  get  it  forced 
through  if  we  had  enough  power  and  influence. 


We  would  attempt  to  quantify  the  qualitative  benefits,  then  it  would 
be  a  struggle,  but  with  DP's  backing  it  would  stand  a  reasonable  chance. 


After  DP  checked  out  the  qualitative  benefits  to  make  sure  they  really 
were  yery   good,  the  proposal  would  be  easily  approved. 


8.  Please  list  all  business  application  systems  with  which  you  have  direct 
or  frequent  contact  in  the  left  hand  column  below  headed  "system  names" 
(for  example,  a  payroll  system). 

A.  In  the  next  column  below,  headed  "type,"  please  post  a  number  from 

1  to  4  which  best  describes  the  basic  type  of  each  DP  system.  Refer 
the  the  Definitions  Page  for  DP  system  type. 

For  each  of  the  DP  systems  you  listed  below,  we  would  like  your 
opinion  on: 

B.  Importance:   the  importance  of  the  system  to  your  department 

C.  Quality:     the  overall  quality  of  the  system 

D.  Development:  the  quality  of  the  development  process  which  created 

and  implemented  the  system 

Post  the  appropriate  number  for  each  from  the  following  scale  to  the  cor- 
responding columns  below: 

very  low  low  high  very   high 


12  3  4                  5                    6  7 

ABC  D 

System  f James  Type  It.iportance  Quality           Development 

1.  

2.  - 

3.  

4.  

5. 


9.   Your  highest  educational  degree: 

Year  Field 


Degree:  /_/   HS   /_/  Bachelors   /_/  Masters   /_/  MBA   /_/  Doctorate 

10.  Your  current  salary  in  thousands  of  dollars  per  year 

/TlO-lS     /T16-20     /T21-25     /"726-30     /T31-35     /T36-40     /T41    &   up 


n.  We  would  like  to  know  if  you  agree  or  disagree  with  the  following 
statements: 

strongly  strongly 

agree  agree           disagree          disagree 


I 
4 


A  We  do  not  request  as  many  new  DP  systems  as  we  would  like 

because  of  the  overload  in  DP. 

B  DP  gives  too  much  priority  to  supporting  and  maintaining  old 

systems  rather  than  developing  new  ones. 

C  I  am  very   frustrated  by  the  low  priority  DP  gives  to  developing 

new  systems  for  our  department. 

D  The  DP  department  is  understaffed. 


12.  Please  rate  your  own  department  on  the  following  characteristics  using 
this  scale. 

very  low  moderate  high  very  high 


5 


A.  reliance  on  DP  for  daily    G.  use  of  DP  systems  by 

managers 

H.  technical  competence  in 
DP  areas 

I.   ability  to  define  your 
system  needs  clearly 

J.   patience  in  dealing  w'th 
DP  problems 

K.   project  management 

services  skills  for  new  systems 

development 
F.   number  of  new  systems 

requested  L.   sophistication  of  new 

systems   requested 


operations 

B. 

v;orkload  Dlaced  on  DP 

department 

C. 

cooperation  in  devel- 

oping new  systems 

D, 

willingness  to  use  DP 

services 

E. 

capabil ity  to  use  DP 

13.  This  question  refers  to  the  support  provided  by  DP  to  users  for  new 
systems  proposal  development.  Please  use  the  following  scale  to  in- 
dicate the  degree  of  current  availability  of  each  aspect  of  p re-pro- 
posal support.  Post  in  the  column  headed  "current." 

no  some  quite  a  bit         extensive 

support  support         of  support  support 


desired   current 


A.  recognizing  potential  areas  for  DP  systems 

B.  developing  the  cost/benefit  estimates  of  a  new  DP 
system 

C.  developing  qualitative  benefits  of  a  new  DP  system 

D.  assessing  the  technical  feasibility  of  a  new  DP 
system 

E.  assessing  the  organizational  impacts  of  a  new  DP 
system 

F.  working  the  politics  of  proposal  or  budget  approval 


Vihat  level  of  pre-proposal  support  do  you  think  the  DP  department  should 
provide  to  users  in  your  organization?  Use  the  same  scale  above  and 
post  your  responses  in  the  column  headed  "desired." 

14.  We  are  interested  in  the  availability,  quality  and  subject  breadth  of 
general  DP  education  courses  for  users  and  how  active  and  supportive 
(arrangements  and  financial)  your  DP  department  is  in  providing  access 
to  these  courses.  Please  indicate  the  current  nature  of  the  DP  educa- 
tion program  supported  by  your  DP  department,  post  your  response,  from 

the  scale  below,  here  .  Now  please  indicate  the  type  of  DP 

education  program  for  users  you  think  DP  should  support,  post  your  re- 
sponse, using  the  same  scale,  here  . 

no  courses         few  courses,       several  courses     extensive  program, 
available         no  support         some  support      actively  supported 


.  1 


15.     Please  rate  the  performance  of  your  DP  department  on  each  factor  listed 
below  using  this  scale. 

very  poor  inadequate  good  excellent 


12  3  4  5  6  7 

A sophistication  of  nev/  systems 

B overall  cost-effectiveness  of  DP 

C  responsiveness  to  user  needs 

D  involvement  of  senior  user  managers  in  DP  policy  formulation  and  evaluation 

E  the  new  system  request  backlog 

F  technical  competence  of  the  DP  staff 

6  attitudes  of  users  to  DP 

H  quality  of  DP  systems  analysts 

I  data  security  and  privacy 

J  development  of  monitor  systems  (DP  system  type  1,  see  Definitions  Page) 

K  development  of  exception  systems  (DP  system  type  2) 

L  development  of  inquiry  systems  (DP  system  type  3) 

M  development  of  analysis  systems  (DP  system  type  4) 

N  training  programs  for  users  in  DP  capabilities 

0  hardware  and  systems  downtime 

P  efficiency  of  hardware  utilization 

Q  the  proportion  of  DP  effort  expended  in  creating  new  systems 

R DP  profitability  from  user  billbacks  and  billable  time  ratios 

S  report  contents  (relevance,  currentness,  flexibility,  accuracy) 

T running  current  systems  (costs,  ease  of  use,  maintenance) 

U availability  and  timeliness  of  report  delivery  to  users 

V  appropriate  DP  budget  size  or  growth  rate 

W  DP  support  for  users  in  preparing  proposals  for  new  systems 

X  user  oriented  systems  analysts  who  know  user  operations 

Y  new  system  development  (time,  cost,  quality,  disruptions) 

Z  communication  with  managerial  users 


16.  For  each  of  the  following  statements  please  indicate  the  extent  of  your 
agreement  or  disagreement.  Use  this  scale  and  post  the  appropriate  num- 
ber next  to  each  statement. 


Strongly  strongly 

disagree  disagree  agree  agree 


A.  In  general  DP  systems  are  a  waste  of  money,  time  and  effort. 

B.  I'd  rather  forego  a  necessary  DP  system  than  get  our  DP  de- 
partment involved. 

C.  Our  DP  department  may  not  be  perfect  but  they  are  better 
than  any  outside  service  bureau. 

D.  We  would  be  better  off  if  running  existing  systems  and  hard- 
ware was  decentralized  and  under  direct  user  control. 

E.  We  would  be  better  off  if  new  systems  development  was  decen- 
tralized and  under  direct  user  controi . 

F.  In  our  company  all  DP  should  be  centralized. 

G.  The  things  a  DP  system  can  do  are  not  important  compared  to 
the  real  needs  of  my  job. 

H.  I  seek  out  opportunities  to  get  DP  involved  in  helping  to 
solve  our  problems. 

I.  All  DP  systems  in  our  department  should  be  developed  and  im- 
plemented by  outside  consultants,  service  bureaus  or  software 
houses. 

J.  DP  systems  are  an  important  tool  for  improving  the  performance 
of  our  department. 

K.  I'll  cooperate  if  required  with  a  DP  system  scheduled  to  be  im- 
plemented in  my  department  but  I  have  more  important  things  to 
do. 

L.  If  we  had  a  really  important  DP  system  to  develop  we'd  be  better 
off  to  go  outside. 
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A.  communication  with  managerial  users 

B.  efficiency  of  hardware  utilization 

C.  hardware  and  systems  downtime 

D.  training  programs  for  users  in  DP  capabilities 

E.  data  security  and  privacy 

F.  quality  of  DP  systems  analysts 

G.  attitudes  of  users  to  DP 

H.  technical  competence  of  the  DP  staff 

I.  the  new  system  request  backlog 

J.  developing  more  monitor  systems  (DP  system  type  1,  see  Definitions  Page) 

K.  developing  more  exception  systems  (DP  system  type  2) 

L.  developing  more  inquiry  systems  (DP  system  type  3) 

M.  developing  more  analysis  systems  (DP  system  type  A) 

N.  involvement  of  senior  user  managers  in  DP  policy  formulation  and  evaluatio 

0.  responsiveness  to  user  needs 

P.  overall  cost-effectiveness 

Q.  increasing  the  proportion  of  DP  effort  expended  in  creating  new  systems 

R.  sophistication  of  new  systems 

S.  improving  new  system  development  (time,  cost,  quality,  disruptions) 

T.  user  oriented  systems  analysts  who  know  user  operations 

U.  DP  support  for  users  in  preparing  proposals  for  new  systems 

V.  appropriate  DP  budget  size  or  growth  rate 

W.  availability  and  timeliness  of  report  delivery  to  users 

X.  running  current  systems  (costs,  ease  of  use,  maintenance) 

Y.  report  contents  (relevance,  currentness,  flexibility,  accuracy) 

Z.  DP  profitability  from  user  billbacks  and  billable  time  ratios 
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